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Abstract. We consider excited random walks on Z with a bounded number 
of i.i.d. cookies per site which may induce drifts both to the left and to the 
right. We extend the criteria for recurrence and transience by M. Zerner and 
for positivity of speed by A.-L. Basdevant and A. Singh to this case and also 
prove an annealed central limit theorem. The proofs are based on results from 
the literature concerning branching processes with migration and make use of a 
certain renewal structure. 



1. Introduction 

We consider nearest-neighbor random walks on the one-dimensional integer lat- 
tice in an i.i.d. cookie environment with a uniformly bounded number of cookies 
per site. The uniform bound on the number of cookies per site will be denoted 
by M > 1, M G N. Informally speaking, a cookie environment is constructed 
by placing a pile of cookies at each site of the lattice (see Figure 1). The piles 
of cookies represent the transition probabilities of the random walker: upon each 
visit to a site the walker consumes the topmost cookie from the pile at that site 
and makes a unit step to the right or to the left with probabilities prescribed by 
that cookie. If the cookie pile at the current site is empty the walker makes a unit 
step to the right or to the left with equal probabilities. 

A cookie will be called positive (resp. negative) if its consumption makes the 
walker to go to the right with probability larger (resp. smaller) than 1/2. A cookie 
which is neither positive nor negative will be called a placebo. Placebo cookies 
allow us to assume without loss of generality that each pile originally consists of 
exactly M cookies. Unless stated otherwise, the random walker always starts at 
the origin. 

The term "excited random walk" was introduced by Benjamini and Wilson in 
[BW03], where they considered random walks on Z'^, c? > 1, in an environment 
of identical cookies, one per each site. Allowing more (or fewer) than one cookie 
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Figure 1 . The top picture is an example of an i.i.d. cookie environment with 
M = 5, which consists of two types of cookie piles. An independent toss of a 
fair coin determines which type of cookie pile is placed at each site of the lattice. 
Various shades of gray allude to different transition probabilities associated to 
different cookies. The bottom picture shows the first few possible steps of a 
random walker in this cookie environment starting at 0. 

per site and randomizing the environment naturally gave rise to the multi-excited 
random walk model in random cookie environments. We refer to [Zer05] and 
[Zer06] for the precise description and first results. It was clear then that this new 
model exhibits a very interesting behavior ior d — 1. We shall mention some of 
the results for d > 2 in Section 9 and now concentrate on the one-dimensional 
case. 

The studies of excited random walks on integers were continued in [MPV06], 
[BS08a], and [BS08b]. [AR05] deals with numerical simulations of this model. In 
all papers mentioned above a (possible) bias introduced by the consumption of 
a cookie was assumed to be only in one direction, say, positive. The recurrence 
and transience, strong law of large numbers [Zer05], conditions for positive linear 
speed [MPV06], [BS08a], and the rates of escape to infinity for transient walks with 
zero speed [BSOSb] are now well understood. Yet some of the methods and facts 
used in the proofs (for example, comparison with simple symmetric random walks, 
submartingale property) depend significantly on this "positive bias" assumption. 
The main novelty of the current paper is in considering cookie environments, 
which may induce positive or negative drifts at different sites or even at the same 
site on successive visits. Our main results are the recurrence/transience criterion 
(Theorem 1), the criterion for positive linear speed (Theorem 2) and an annealed 
central limit theorem (Theorem 3). The first two theorems are extensions of 
those for non-negative cookie environments but we believe that this is a purely 
one-dimensional phenomenon. Moreover, in Section 9 we give an example, which 
shows that, at least for d > 4, the criteria for recurrence or transience and for 
positive linear speed can not depend just on a single parameter, the average total 
drift per site (see (3)). The order of the cookies in the pile should matter as well. 

The proofs are based on the connections to branching processes with migration. 
Branching processes allowing both immigration and emigration were studied by 
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several authors in the late 70-ties through about the middle of the 90-ties, and 
we use some of the results from the literature (Section 2). See the review paper 
[VZ93] for more results and an extensive list of references up to about 1990. The 
connection between one- dimensional random walks and branching processes was 
observed long time ago. In particular, it was used for the study of random walks in 
random environments, see e.g. [KKS75]. In the context of excited random walks, 
this idea was employed recently in [BS08a] , [BS08b] (still under the "positive bias" 
assumption). In the present paper we are using results from the literature about 
branching processes with migration in a more essential way than [BSOSa] and 
[BS08b]. One of our tasks is to show how to translate statements about excited 
random walks into statements for a class of branching processes with migration 
which have been studied in the past. 

Let us now describe our model, which we shall abbreviate by ERW, more pre- 
cisely. A cookie environment uj with M cookies per site 2; G Z is an element 
of 

:= {{{uj{z,i))ien),ez \ u;{z,i) E [0,1], G {1,2,...,M} 

and uj{z,i) = 1/2, Vi > M, eZ}. 

The purpose of u{z,i) is to serve as the transition probability from ^ to ;i; + 1 of 
a nearest-neighbor ERW upon the i-th visit to a site z. More precisely, for fixed 
UJ G flM and a; G Z an ERW (X„)„>o starting from x in the cookie environment uj 
is a process on a suitable probability space with probability measure P^^u) which 
satisfies: 



Px,uj [Xo 



X\ 



Px,U) [^71+1 



0<j<?ij 
1 |(^i)o<j<n] 



w(X„,#{2<n|X, = X„}), 
l-cu(X„,#{2<n|X, = X„}). 



The cookie environment uj may be chosen at random itself according to a probabil- 
ity measure on VLmi which we shall denote by P, with the corresponding expecta- 
tion operator E. Unless stated otherwise, we shall make the following assumption 
on P: 



(1) 



The sequence {uj{z, •))zgi is i-i-d. under P. 



Note that assumption (1) does not imply independence between different cookies 
at the same site but only between cookies at different sites, see also Figure 1. To 
avoid degenerate cases we shall also make the following mild ellipticity assumption 
on P: 



(2) 



E 



M 



T]uj{o,t) 



> and E 



M 



17(1 -^0,z)) 



> 0. 
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After consumption of a cookie u!{z, i) the random walk is displaced on Paj^^^-average 
by 2uj{z, i) — 1. This average displacement, or drift, is positive for positive cookies 
and negative for negative ones. The consumption of a placebo cookie results in 
a symmetric random walk step. Averaging the drift over the environment and 
summing up over all cookies at one site defines the parameter 

M 



(3) 5 := E 



J](2a;(0,i)-1) 



J](2a;(0,i)-1) 



which we shall call the average total drift per site. It plays a key role in the 
classification of the asymptotic behavior of the walk as shown by the three main 
theorems of this paper. 

Our first result extends [Zer05, Theorem 12] about recurrence and transience 
for non-negative cookies to i.i.d. environments with a bounded number of positive 
and negative cookies per site. 

Theorem 1 (Recurrence and transience). If 5 e [—1, 1] then the walk is recurrent, 
i.e. for W-a.a. environments uo it returns P^^^-a.s. infinitely many times to its 
starting point. If 6 > 1 then the walk is transient to the right, i.e. for F-a.a. 
environments cu, Xn oo as n — > oo Po^i^-a.s.. Similarly, if 5 < —1 then the walk 
is transient to the left, i.e. Xn — > — oo as n — > oo. 

Trivial examples with M = 1 and ci;(0, 1) = or a;(0, 1) = 1 show that assump- 
tion (2) is essential for Theorem 1 to hold. 

Our next result extends [MPV06, Theorem 1.1, Theorem 1.3] and [BS08b, The- 
orem 1.1] about the positivity of speed from spatially uniform deterministic envi- 
ronments of non-negative cookies to i.i.d. environments with positive and negative 
cookies. 

Theorem 2 (Law of large numbers and ballisticity) . There is a deterministic 
V e [—1, 1] such that the excited random walk satisfies for P-a.a. environments cu, 

lim — - = V Po^i_j-a.s.. 

n—*oo n ' 

Moreover, v < for S < -2, v ^ for 5 e [-2, 2] and v > for S > 2. 

While Theorems 1 and 2 give necessary and sufficient conditions for recurrence, 

transience, and the positivity of the speed, the following central limit theorem 
gives only a sufficient condition. To state it we need to introduce the annealed, or 
averaged, measure -Pr[ ■ ] := E [Px,ui[ ■ ]]■ 

Theorem 3 (Annealed central limit theorem). Assume that \6\ > 4. Let v be the 
velocity given by Theorem 2 and define 

:= -^{X\tn\ - \tn\v) for t > 0. 
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Then (-B")i>o converges in law under Pq to a non- degenerate Brownian motion 
with respect to the Skorohod topology on the space of cadlag functions. 

The variance of the Brownian motion in Theorem 3 will be further characterized 
in Section 6, see (28). 

Let us describe how the present article is organized. Section 2 introduces the 
main tool for the proofs, branching processes with migration, and quotes the rel- 
evant results from the literature. In Sections 3 and 4 we describe the relationship 
between ERW and branching processes with migration and introduce the nec- 
essary notation. In Section 5 we use this relationship to translate results from 
Section 2 about branching processes into results for ERW concerning recurrence 
and transience, thus proving Theorem 1. In Section 6 we introduce a renewal 
structure for ERW, similar to the one which appears in the study of random walks 
in random environments (RWRE), and relate it to branching processes with mi- 
gration. In Sections 7 and 8 we use this renewal structure to deduce Theorems 2 
and 3, respectively, from results stated in Section 2. The final section contains 
some concluding remarks and open questions. 

Throughout the paper we shall denote various constants by q G (0, oo), i > 1. 

2. Branching processes with migration - results from the 

literature 

In this section we define a class of branching processes with migration and quote 
several results from the hterature. We chose to give the precise statements of the 
results that we need since some of the relevant papers are not readily available in 
English. 

Definition 1. Let n and u be probability measures on No := N U {0} and Z, 

respectively, and let and rik > 1, A; > 0) be independent random variables 

(i) 

such that each Q has distribution jj, and each rjk has distribution i/. Then the 
process {Zk)k>o, recursively defined by 

(4) Zo:=0, Zk+i -.^ C?^'^ + . . . + k>0, 

is said to be a (/i, v)-hranching process with offspring distribution fi and migration 
distribution v. (Here we make an agreement that ^^^^'^ -|- . . . -|- ^f"^^^ = if 
i < 0.) An offspring distribution fi which we shall use frequently is the geometric 
distribution with parameter 1/2 and support Nq. It is denoted by Geom(l/2) . 

Note that any (/x, z/)-branching process is a time homogeneous Markov chain, 
whose distribution is determined by //, and v. More precisely, if at time k the 
size of the population is Zk then (1) rjk individuals immigrate or minjZfc, \rik\} 
individuals emigrate depending on whether r/^ > or r/fc < respectively, and 
(2) the resultant {Zk + r)k)+ individuals reproduce independently according to the 
distribution /i. This determines the size Z^+i of the population at time A; -|- 1. 
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In the current paper we are interested in the case when both the immigration 
and the emigration components are non-trivial and the number of emigrants is 
bounded from above. This bound will be the same as the bound M on the number 
of cookies per site. We shall assume that 

(5) iy{N) > and iy{{k eZ\k> -M}) = 1. 
Denote the average migration by 

(6) A:= 5] 

k>-M 

and the moment generating function of the offspring distribution by 

/(s):=5^MW)s^ se[o,i]. 

k>0 

In addition to (5), we shall make the following assumptions on the measures /j, 
and u: 

(A) /(0)>0, /'(1) = 1, 6 := r (l)/2 < oo, A < oo; 

(B) J]/x({A;})A;MnA; < oo. 

k>l 

Note that fi = Gcom(l/2) satisfies condition (A) on the moment generating func- 
tion / with 6=1. It also satisfies (B). 

Next we state a result from the literature, which relates the limiting behavior 
of the process {Zk)k>o to the value of the parameter 

(7) . 

At first, introduce the stopped process {Zk)k>o- Let 

(8) Ar(^) inf{A; > 1 | = 0} and Zk := Zkl{k<m^)}- 

Note that the process {Zf;)k>o follows {Zk)k>o until the first time {Zk)k>o returns 
to 0. Then {Zk)k>o stays at whereas {Zk)k>o eventually regenerates due to the 
presence of immigration (see the first inequality in (5)). 

Theorem A ([FY89], [FYK90]). Let {Zk)k>o be a {/i,!/) -branching process satis- 
fying (5), (A) and (B). We let 

Un -.^ P[N^^^ > n] ^ P[Zn > 0], neN, 
describe the tail of the distribution of N^^^ and denote by 



E 



m=0 



the expectation of the total progeny of {Zk)k>o up to time n e No U {oo}. Then 
the following statements hold. 
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(i) If 9 > 1 then lim m„ = ci G (0, 1), in particular, the process {Zk)k>Q has a 
strictly positive chance ci never to die out. 

(ii) If 9 — 1 then lim u„lnn = C2 G (0, cxd), in particular, the process {Zk)k>o 

n—*oo 

will eventually die out a.s.. 

(iii) If 9 — —1 then lim w„(lnn)~^ — & (0,oo), in particular, — oo, i.e. 

n^oo 

the expected total progeny of {Zk)k>Q, foo; is infinite. 

(iv) If9< -1 and 

^A;^+l^lAt({A;}) <oo 

k>l 

then lim UnTi^'^^^^ — & (0,oo). Moreover, in this case lim Vn — c^ & 

n—*oo n-+oo 

(0, oo); i.e. the expected total progeny of {Zk)k>o is finite. 

The above results about the hmiting behavior of u„ are contained in Theorems 
1 and 4 of [FY89], [FYK90]. The proofs are given only in [FYK90]. The behavior 

of Vn is the content of formula (33) in [FYK90]. The statements (i) and (ii) of 
Theorem A also follow from [YY95, Theorem 2.2] (see also [YMY03, Theorem 
2.1]). 

Remark 1. We have to point out that we use a slightly different (and more 
convenient for our purposes) definition of the lifetime, N^^\ of the stopped process. 
More precisely, our quantity Un can be obtained from the one in [FYK90] by the 
shift of the index from n to n — 1 and multiplication by 

p[z,>o] = ^u{{k}) (1-MW)'), 

k>l 

which is positive due to the first inequality in (5) and the fact that /i({0}) < 1 
(by the condition /'(I) = 1 of assumption (A)). A similar change is needed for the 
expected total progeny of the stopped process. Clearly, these modifications affect 
only the values of constants in Theorem A and not their positivity or finiteness. 

The papers mentioned above contain other results but we chose to state only 
those that we need. In fact, we only use the first part of (iv) and the following 
characterization, which we obtain from Theorem A by a coupling argument. 

Corollary 4. Let the assumptions of Theorem A hold. Then {Zk)k>o dies out a.s. 
iff 9 < I. Moreover, the expected total progeny of {Zk)k>o, Voo, is finite iff9<—l. 

Proof. Theorem A (i) gives the 'only if '-part of the first statement. To show the 
'if direction we assume that 6' < 1, i.e. v has mean X < b (see (7)). Then there 
is another u' with mean b which stochastically dominates u. Indeed, if X has 
distribution i/ and Y has expectation b — X and takes values in No then u' can 
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be chosen as the distribution of X + Y. By couphng, the {n, i/')-branching pro- 
cess stochastically dominates the {/i, i/)-branching process. However, the {/i, v')- 
branching process dies out a.s. due to Theorem A (ii) since for this process 9 — 1. 
Consequently, the (/i, z/)-branching process must die out, too. 

Similarly, Theorem A (iv) gives the 'if '-part of the second statement. The 
converse direction follows from monotonicity as above and Theorem A (iii). □ 

3. From ERWs to branching processes with migration 

The goal of this mainly expository section is to show how our ERW model can 
be naturally recast as a branching process with migration. This connection was 
already observed and used in [BS08a] and [BS08b]. 

Consider a nearest neighbor random walk path (X^fj)„>o, which starts at and 
define 

Tk inf{n > 1 | X.„ = A;} G N U {cx)}. A; G Z. 

Assume for the moment that Xi = 1 and consider the right excursion, i.e. (Xn)o<n<To- 
The left excursion can be treated by symmetry. 

On the set {Tq < oo} we can define a bijective path-wise mapping of this right 
excursion to a finite rooted tree, which corresponds to a realization of a branching 
process with the extinction time max{X„, < n < Tq} as illustrated in Figure 2. 
Moreover, given a tree for a branching process that becomes extinct in finite time, 
we can reconstruct the right excursion of the random walk. This can be done 
by making a time diagram of up and down movements of an ant traversing the 
tree in preorder: the ant starts at the root, always chooses to go up and to the 
left whenever possible, never returns to an edge that was already crossed in both 
directions, and finishes the journey at the root (Figure 2, (III)). 

The above path- wise correspondence on {Tq < oo} does not depend on the 
measure associated to the random walk paths. To consider the set {Tq = oo} we 
shall need some of the properties of this measure. The following simple statement 
leaves only three major possibilities for a long term behavior of an ERW path. 

Lemma 5. Let u e flM- Then Po .j-a.s. 

liminfX„, limsup X„ e {— oo, -|-oo}. 

Proof. Let 2; e Z. If the ERW visits z infinitely many times then it also visits z + 1 
infinitely many times due to the second Borel Cantelli lemma, the strong Markov 
property, and the assumption uj{z,i) = 1/2 for i > M. This implies Po,w-a.s. 
limsup„X„ ^ Z. Similarly, Po,a;-a.s. hminf„X„ ^ Z. □ 

Let us now put a measure on the paths and see what kind of measure will be 
induced on trees. Consider the right excursion of the simple symmetric random 
walk. Assume without loss of generality that the walk starts at 1. Then the 
probability that Tq < 00 is equal to one and the corresponding measure on trees 
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(I) 




(11) 




Figure 2 . (I) Right excursion of the random walk. Upcrossings are marked 
by "tree leaves" . (II) The number of upcrossings of the edge {k, k + 1) becomes 
the number of particles in generation k for the branching process. Shrinking 
the horizontal lines in (II) into single points gives the tree (III). Traversing the 
tree (III) in preorder rebuilds the excursion (I). 



will be the one for a standard Galton- Watson process with the Geom(l/2) offspring 
distribution starting from a single particle. More precisely, set Uq :— 1 and let 

(9) C/fc := #{n > I n< Tq, = k, X^+i = A; + 1}, A; > 1, 

be the number of upcrossings of the edge (A;, k+1) by the walk before it hits 
0. Then {Uk)k>o has the same distribution as the Galton- Watson process with 
Geom(l/2) offspring distribution. Therefore, {Uk)k>o can also be generated as 
follows: start with one particle: Uq = 1. To generate the {k + l)-st generation 
from the A;-th generation (assuming that the process has not yet died out), the first 
particle of generation k tosses a fair coin repeatedly and produces one offspring 
if the coin comes up "heads". It stops the reproduction once the coin comes 
up "tails". Then the second particle in generation k follows the same procedure 
independently, then the third one, and so on. Consequently, 

Uk+i — ?i + ■ • ■ + ?[/fc ' 
where i,j > 1 are independent with distribution Geom(l/2) . 
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To construct a branching process corresponding to an ERW with M cookies per 
site one can use exactly the same procedure except that for the first M coin tosses 
in the /c-th generation the particles should use coins with biases "prescribed" by the 
cookies located at site k. Since every particle tosses a coin at least once, at most the 
first M particles in each generation will have a chance to use biased coins. All the 
remaining particles will toss fair coins only. This can be viewed as a branching 
process with migration in the following natural way. Before the reproduction 
starts, the first UkAM particles emigrate, taking with them all M biased coins and 
an infinite supply of fair coins. In exile they reproduce according to the procedure 
described above. Denote the total number of offspring produced by these particles 
by Vu^AM- Meanwhile, the remaining particles (if any) reproduce using only fair 
coins. Finally, the offspring of the emigrants re-immigrate. Therefore, the number 
of particles in the generation k + 1 can be written as 

where .^p'' and t]^'^^ (^,J, A; > 1, < £ < M) are independent random variables, 
each one of the sequences (^o'^^)fc>i, • • • , ('7m )fc>i is identically distributed, and 
each has distribution Geom(l/2) . 

Branching processes of type (10) were considered in [BSOSa] (p. 630) and [BS08b] 
(p. 815), except that they were generated not by the forward but by the backward 
excursion (see (29) in Section 6). Careful analysis of such processes carried out in 
these two papers yielded results concerning positive speed and rates of growth at 
infinity for ERWs with non-negative cookies. However, from a practical point of 
view, (/i, z/)-branching processes, introduced in Definition 1, seem to be well-known 
and studied more extensively in the past. In particular, we could find the results 
we need (see Theorem A) in the literature only for (/x, i/)-branching processes, but 
not for processes of the form (10). For this reason one of our main tasks will be 
to relate these two classes of processes in order to translate the results from the 
hterature into results about processes of the form (10). 

4. COIN-TOSS CONSTRUCTION OF THE ERW AND THE RELATED 
(/X, I/)-BRANCHING PROCESS 

In this section we formalize a coin-toss construction of the ERW and introduce 
auxiliary processes used in the rest of the paper. 

Let (f2, JF) be some measurable space equipped with a family of probability 
measures Px,ixn x e Z, a; e Qm, such that for each choice of x e Z and uj e Q^m 

(k) 

we have ±1- valued random variables 1^/ , A; G Z, i > 1, which are independent 
under Px,oj with distribution given by 

PxAy^'^ = 1] = cuik, i) and ^ = -1] = 1 - cuik, i). 
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Moreover, we require that there is a random variable Xq on (fi, JF, Px,uj) such that 
Px,<A^ii — x\ — l. Then an ERW (^n)n>o, starting at x e Z, in the environment 
uj can be reahzed on the probabihty space (Jl, Px,uj) recursively by: 

(11) ^n+l ^n + ^#^<„|x,=X„}' ^ > 0. 

We shall refer to {v/'^'' = 1} as a "success" and to {Y^^^ = —1} as a "failure". 
Due to (11) every step to the right or to the left of the random walk corresponds 
to a success or a failure, respectively. 

Wc now describe various branching processes that appear in the proofs. Namely, 
we introduce processes {Vk)k>o, (W4)fc>05 ^ind (Zfc)fc>o. Modifications of the first 
two processes suitable for left excursions will be defined later when they are needed 
(we shall keep the same notation though, hoping that this will not lead to con- 
fusion). The last process, {Zk)k>o, will belong to the class of processes from 
Section 2. 

For m G N and k G Z let 

(12) S'q^-* := 0, S^^ := # of successes in prior to the m-th failure. 

Recall from the introduction that Px[-] denotes the averaged measure E[Pa;^(^[ • ]]. 
By assumption (2) the walk reaches 1 in one step with positive Po-pi'obability. 

We shall be interested in the behavior of the process {Uk)k>o defined in (9). At 
first, we shall relate {Uk)k>o to (yk)k>o which is recursively defined by 

(13) Vo:=l, yfe+i:=4^'^ ^ > 0- 

Observe that {Vk)k>o is a time homogeneous Markov chain, as the sequence of 

sequences (5'm'*)m>0! A; > 0, is i.i.d.. Moreover, is an absorbing state for {Vk)k>o- 
We claim that under Pi, 

(14) Uk = Vk for all A; > on the event {Tq < oo}; 

(15) Uk < Vk for all A; > on the event {To = oo}. 

The relation (14) is obvious from the discussion in Section 3 and Figure 2. To 
show (15) we shall use induction. Recall that Uq = Vq = I and assume Ui <Vi 
for all i < k. Prom Lemma 5 we know that Xn ^ oo as n ^ oo on {Tq = oo} a.s. 
with respect to Pi. Therefore, the last, Uk-th, upcrossing of the edge {k,k + 1) 
by the walk is not matched by a downcrossing. This implies that Uk+i should be 
less than or equal to the number of successes in the sequence (f/^'*'^'*)^^^ prior to 
the Uk-th failure. On the other hand, to get the value of Vk+i one needs to count 
all successes in this sequence until the Vfc-th failure. Since Uk < Vk, we conclude 
that Uk+i < Vk+i. 

Next we introduce the process {Wk)k>o by setting 

(16) Wo-.^O, Wk+i-.^S^il^^, k>0. 
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Just as (Vfc)fc>o, the process {Wk)k>o is a time homogeneous Markov chain on 
non-negative integers. Moreover, the transition probabihties from i to j of these 
two processes coincide except for i G {0, 1, .... Af — 1} and both processes can 
reach any positive number with positive probabihty. Therefore, if one of these two 
processes goes to infinity with positive probabihty, so does the other: 

(17) Pi[V^fe^oo]>0 ^ Pi[Wk ^oo]>0. 

Finally, we decompose the process {Wk)k>o into two components as follows. 

Lemma 6. For k > let := Wk+i — S]^\ Then {Zk)k>o is a (Geom(l/2), u)- 
branching process, where v is the common distribution of rjk := — M under 
Pi. 

Proof. By definition, Zq = and 

where C.l'^'^^^ is defined as the number of successes in (^/^^^''),>^ between the 
(M + i — l)-th and the (M + i)-th failure, i > 1. Therefore, by definition of Z^. 
and r)k, 

Since u{k,m) — 1/2 for m > M, the random variables Ym \ m > M, k > 0, 
are independent and uniformly distributed on { — 1,1} under Pi. From this we 
conclude that the ^l^"*, k,i > 1, have distribution Geom(l/2) . To show the 
independence of ^p'' and rjk > 1, k > 0), as required by Definition 1, notice 
that rjk = S^j^^ — M depends only on Ym \ where m changes from 1 to the number 
of the trial resulting in the M-th failure inclusively, while each ^^''\ i > 1, counts 
the number of successes in (^m'^^)„>i between the (M+i — l)-th and the (M-l-i)-th 

failure. Recalling again that m > 1, A; > 0, are independent under Pi, we 
get the desired independence. □ 

Having introduced all necessary processes we can now turn to the proofs of our 
results. 



5. Recurrence and transience 

Definition 2. The ERW is called recurrent from the right if the first excursion to 
the right of 0, if there is any, is Po-a.s. finite. Recurrence from the left is defined 
analogously. 
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In the next lemma we shall characterize ERW which are recurrent from the 
right in terms of branching processes with migration. At first, we shall introduce 
a relaxation of condition (1), which is needed for the proof of Theorem 1: 

(18) The sequence {uj{k, ■))k>K is i-i-d. under P for some K eN. 

Under this assumption the sequence indexed hy k > K of sequences (^/'^'')i>i is 
i.i.d. with respect to Pq. In particular, the sequence {S^^^)k>K is i-i-d. under Pq- 

Lemma 7. Replace assumption (1) by (18) and assumption (2) by 

M 

\{{l-u{K,i)) 



(19) 



E 



,1=1 



> 0- 



Denote the common distribution ofrjk := S\/ — M, k> K, under Pq by v. Then 
the ERW is recurrent from the right if and only if the {Geom[l / 2), u)- branching 
process dies out a.s., i.e. reaches state at some time k >1. 

Proof. Since we are interested in the first excursion to the right we may assume 
without loss of generality that the random walk starts at 1. Then, recalling def- 
inition (9), we have {Tq = oo} = {VA; > 1 C/^ > 0}, where A ^ B means that 
the two events A and B may differ by a Pi-nuU-set only. Indeed, since Uk counts 
only upcrossings of the edge {k, k + 1) prior to Tq, the inclusion D is trivial. The 
reverse relation follows from Lemma 5. This together with (14) and (15) implies 
that 

(20) {To = cx)} = {VA; > Vfe > 0}. 

As above {Vk)k>K is a time homogeneous Markov chain since the sequence of 
sequences {Sm^)m>o, k > K, is i.i.d.. For any m the transition probability of this 
Markov chain from m e N to is equal to 



Pi[5i^) = 0]=E 



l[il-u;{K,i)) 



which is strictly positive by (19). Since is absorbing for {Vk)k>o get that 

{VA; > Vfc > 0} = {\4 ^ oo}. Consequently, by (20), {Tq = oo} = {14 ^ oo}. 
Next we turn to the process (Wk)k>o and recall relation (17). Thus, 

(21) p,[To = oo]=0 ^ Pi[Wk ^ oo] = 0. 

Finally, we decompose the process {Wk)k>o as in Lemma 6 by writing Wk+i = 
Zk + S^^^ for A; > 0, where {Zk)k>K is a Markov chain with the transition kernel 
of a (Geom(l/2), z/)-branching process. Since the sequence {S^j^^)k>K is i.i.d., this 



implies that {Wk oo} = {Zk — > oo}. Together with (21) this shows that 
the ERW is recurrent from the right iff Po[Zk — > oo] = 0. Since {Zk)k>K is an 
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irreducible Markov chain this is equivalent to {Zk)k>K being recurrent, which is 
equivalent to recurrence of the state for (Geom(l/2), z/)-branching processes. □ 

Lemma 8. Assume again (1) and (2). If the ERW is recurrent from the right 
then all excursions to the right of are Po-a.s. finite. If the ERW is not recurrent 
from the right then it will make Po-a.s. only a finite number of excursions to the 
right. The corresponding statements hold for recurrence from the left. 

Proof. Let the ERW be recurrent from the right. By Definition 2 the first excursion 
to the right is a.s. finite. By Lemma 7 the corresponding (Geom(f/2), z/)-branching 
process dies out a.s.. Let i > 1 and assume that all excursions to the right up to 
the i-th one have been proven to be Po-a.s. finite. If the ERW starts the {i + l)-st 
excursion to the right of then it finds itself in an environment which has been 
modified by the previous i excursions up to a random level R> 1, beyond which 
the environment has not been touched yet. Therefore, conditioning on the event 
{R = K}, K > 1, puts us within the assumptions of Lemma 7: the random walk 
starts the right excursion from in a random cookie environment which satisfies 
(18). But the corresponding (Geom(l/2), i/)-branching process is still the same 
and, thus, dies out a.s.. Therefore, this excursion, which is the (i+ l)-st excursion 
of the walk, is a.s. finite on {R = K}. Since by our induction assumption the 
events {R = K}, K >1, form a partition of a set of full measure, we obtain the 
first statement of the lemma. 
For the second statement let 

D := inf{n > 1 | X„ < Xq} 

be the first time that the walk backtracks below its starting point. Due to (2), 
Pq[Xi = 1] > 0. Therefore, since the walk is assumed to be not recurrent from 
the right, 

(22) Pq[D = oo] > 0. 

Denote by the right-most visited site before the end of the i-th excursion and 
define Ki = oo ii there is no i-th right excursion or if the i-th excursion to the 
right covers N. Then the number of i > 1 such that Ki < A'j+i, is stochastically 
bounded from above by a geometric distribution with parameter Pq[D = oo]. 
Indeed, each time the walk reaches a level Ki + 1 < oo, which it has never visited 
before, it has probability Po[D = oo] never to backtrack again below the level 
Ki + 1, independently of its past. Therefore, {Ki)i increases only a finite number 
of times. Hence Pg-a-s. R := su]){Ki \ i > 1, Ki < oo} < oo. Now, if the walk did 
an infinite number of excursions to the right, then, Pq-^.s. sup„ X„ = it! < oo and 
limsup„X„ > 0, which is impossible due to Lemma 5. □ 

Proposition 9. The ERW is recurrent from the right if and only if S < 1. Simi- 
larly, it is recurrent from the left if and only if S > —1. 
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For the proof we need the next lemma, which relates the parameter 6 of the 
ERW and the parameter 9 of the branching process with migration. 

Lemma 10. Let v he the distribution of — M under Pq. Then 6 defined in 
(7) for the (Geom(l/2), u)-hranching process is equal to 5 defined in (3). 

Proof of Lemma 10. For ^ = Geom(l/2) the parameter b defined in (A) equals 1. 
Hence, by (6), 6' = A = Eo[S^^ — M]. Thus it suffices to show that 

(23) Eo[S^2] -M^S. 

This has already been observed in [BSOSb, Lemma 3.3]. For completeness, we 
include a proof. Let F :— #{1 < i < M \ 1^*^°^ = —1} be the number of failures 
among the first M trials. Then M — F is the number of successes among the first 
M trials. Therefore, since S^^j is the total number of successes prior to the M-th 

failure, — (M — F) is the number of successes after the M-th trial and before 
the M-th failure. Given F, its distribution is negative binomial with parameters 
M — F and p = 1/2, i.e. the (M — F)-fold convolution of Geom(l/2) , and therefore 
has mean M — F. Thus, 

Eo[S^3 -{M- F)] = Eo[Eo[S^S - {M - F) \ F]] = Eo[M - F]. 
Subtracting Eo[F] from both sides we obtain 

M M 

Eo[S^2] - M = M - 2 J] E[l - ouiO, i)] - J](2E[a;(0, i)] -1)^5. 

i=i i=i 

□ 

Proof of Proposition 9. Due to Lemma 7 the walk is recurrent from the right iff 
the (Geom(l/2), i/)-branching process dies out a.s., where u is the distribution of 
— M. By the first statement of Corollary 4 this is the case iff ^ < 1. The first 
claim of the proposition follows now from Lemma 10. The second one follows by 

symmetry. □ 

Proof of Theorem 1. If 5 > 1 then by Proposition 9 the walk is not recurrent from 
the right but recurrent from the left. If the walk returned infinitely often to 
then it would also make an infinite number of excursions to the right which is 
impossible due to Lemma 8. Hence the ERW visits only finitely often. Since 
any left excursion is finite due to Lemma 8 the last excursion is to the right and 
is infinite. Consequently, Pq-^-S. liminf„X„ > 0, and therefore, due to Lemma 5, 
Xn oo. Similarly, 5 < —1 implies Po-a.s. Xn oo. 

In the remaining case 5 e 1] a-U excursions from are finite due to Propo- 
sition 9. Hence, is visited infinitely many times. □ 
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Figure 3. 


A random walk path with two renewals. 





Remark 2. The equivalence (20) also holds correspondingly for one-dimensional 
random walks (Xn)n>o in i-i-d. random environments (RWRE) and branching pro- 
cesses (Vfc)fc>o in random environments, i.e. whose offspring distribution is geomet- 
ric with a random parameter. This way the recurrence theorem due to Solomon 
[So75, Th. (1.7)] for RWRE can be deduced from results by Athreya and Karhn, 
see [AN72, Chapter VI.5, Corollary 1 and Theorem 3]. 



6. A RENEWAL structure FOR TRANSIENT ERW 

A powerful tool for the study of random walks in random environments (RWRE) 
is the so-called renewal or regeneration structure. It is already present in [KKS75], 
[Ke77] and was first used for multi-dimensional RWRE in [SZ99] . It has been men- 
tioned in [Zcr05, p. 114, Remark 3] that this renewal structure can be straightfor- 
wardly adapted to the setting of directionally transient ERW in i.i.d. environments 
in order to give a law of large numbers. The proofs of positivity of speed and of a 
central limit theorem for once-excited random walks in dimension d > 2 in [BR07] 
were also phrased in terms of this renewal structure. We shall do the same for the 
present model. 

Wc continue to assume (1) and (2). Let 5 > 1, where 5 is the average drift 
defined in (3). This means, due to Theorem 1, that Po-a-s. Xn oo. Moreover, 
by Proposition 9, the walk is not recurrent from the right, which implies, as 
we already mentioned, see (22), that Pq[D = cxd] > 0. Hence there are Po-a.s. 
infinitely many random times n, so-called renewal or regeneration times., with the 
defining property that X^ < Xn for all < m < n and > X^ for all m > n. 
Call the increasing enumeration of these times {rk)k>i, see also Figure 3. Then the 
sequence (X^^,ri), (X^^^.^^— X^^^., Tfc+i— r^) {k > 1) of random vectors is independent 
under Pq. Furthermore, the random vectors (X^-^^^ — Xr^, Tk+i — r^). A; > 1, have 
the same distribution under Pq- For multidimensional RWRE and once-excited 
random walk the corresponding statement is [SZ99, Corollary 1.5] and [BR07, 
Proposition 3], respectively. It follows from the renewal theorem, see e.g. [Zei04, 
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Lemma 3.2.5], that 

(24) Eo[Xr, - Xr,] = Po[D = oo]-' < oo. 

Moreover, the ordinary strong law of large numbers implies that 

(25 hm — = =: v Po-a.s., 

n^oo n Eq[T2 — Ti\ 

see [SZ99, Proposition 2.1] and [Zei04, Theorem 3.2.2] for RWRE and also [BR07, 
Theorem 2] for once-ERW. Therefore, 

(26) v > if and only if Eq[t2 — Ti] < oo. 
If, moreover, 

(27) £;o[(t2-Ti)2] <oo 
then the result claimed in Theorem 3 holds with 

(28) :^ E.jjX.^ - X .jr^ - r.)f] ^ ^ 

see [SzOO, Theorem 4.1] for RWRE and [BR07, Theorem 3 and Remark 1] for 
once-ERW. 

Thus, in order to prove Theorems 2 and 3 we need to control the first and the 
second moment, respectively, of T2 — ti. We start by introducing for A; > the 
number 

(29) Dfe := # {n I Ti < n< T2, X„ = X^^ - k, ^ X^ - k - 1} 

of downcrossings of the edge {Xr^ — k, Xr^ — k — 1) between the times t\ and T2. 

Lemma 11. Assume that the ERW is transient to the right and let p > 1. Then 
the p-th moment of T2 — Ti under Pq is finite if and only if the p-th moment of 
X)fe>i-Dfe is finite. 

Proof. The number of upcrossings between ri and T2 is X^.^ —Xj.-^ +Xlfe>i -^fc' since 
Xj-^ < Xj^ and since each downcrossing needs to be balanced by an upcrossing. 
Each step is either an upcrossing or a downcrossing, therefore, 

(30) T2 - Ti = Xr, -Xr,+2J2 ^k- 

k>l 

For every k e {X^^ + 1, . . . , Xr^ — 1} there is a downcrossing of the edge {k, k — 1), 
otherwise k would be another point of renewal. Hence, Xt^ — Xt^ < 1 + ^k>i 
and, by (30), 

2j2Dk<r2-Ti < l + 3^Dfc. 

k>l k>l 

This implies the claim. □ 
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X 



r2 



■A 



£'2 = 2 
^4 = 4 



Figure 4. For the path in Fi gure 3 the process {Dk)k>o is reahzed as 
(0,1,2,4,4,0,0,...). The sohd hnes represent downcrossings. The thick dots on 
the dashed hne correspond to the single immigrant in definition (32). 

To interpret {Dk)k>o as a branching process (see Figure 4) we define for m e N 

and k G Z 

(31) F^''^ := 0, F^^ := # of failures in {Y^^''^).^^ prior to the m-th success. 

(Compare this to the definition of Sm'' in (12).) Let 

(32) Vo := 0, Vk+, := Fg^„ A; > 0; 

(33) Vk := Vkl{k<N(v)}, where Ar(^) inf{A; > 1 | l^fe = 0}. 

Lemma 12. Assume that the ERW is transient to the right. Then (£)fe)fe>o and 
{Vk)k>Q have the same distribution under Pq. 

— * — * 

Proof. Fix an integer K > 1. For brevity, we set D {Di, . . . , Dk) and V :— 
{Vi, . . . ,Vk)- It suffices to show that 



(34) 



Pn 



D 



V 



for all i e N^. Since both processes start from and also stay at once they 

have returned to for the first time, it is enough to consider vectors i whose 
entries are strictly positive except for maybe the last one. And, since the process 
{Dk)k>o eventually does reach Po-a.s., namely at /c = Xr^ — Xr^ < oo, it suffices 
to consider only i whose last entry is 0. Thus, let i — (ii, . . . ^ik) G Nq with 
ii, . . . , iK-i > 1 and ik — 0. At first, we shall show that 



Po 



D 



Po 



(35) 

where, for m,k>0, 

(36) D^^'^ := #{n < | A:„ = m - A;, X^+i ^ m - k - 1} and 
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We start from the partition equation 



(37) 



Po 



D 



m>0 



However, on the event {D = i, T2 = Tm}, we have = m — K hj our choice of 
i. Since X^-^ > 0, we may start the summation in (37) from m = K. Moreover, 
comparing the definitions (29) and (36), we see that {D = i, T2 = T^} = = 
i, T2 = Tm}, using that not only on the left but also on the right event we have 
Xj.^ — m — K. Hence, the right hand side of (37) is equal to 



(38) 



m>K 

Notice that the event {t2 = Tm} occurs if and only if the ERW does not fall below 
level m after time Tm and if exactly one of the numbers , ■ ■ ■ , Drn^ is equal 
to 0. Then, by our choice of i, (38) is equal to 

J2 Po [^^""^ = h yk = K +l,...,m: d'^^ > 1, Vn > : X„ > m . 

m>K 

By the strong Markov property applied to the stopping time and by indepen- 
dence in the environment this equals 

Po Id^""^ = h yk = K + l,...,m: d'^^ > ij Pm[D = 00]. 

m>K 

Since ix = 0, this is the same as 

^{m-K) 

L Q U — t, V/v — ±, . . . , /(t — . J. 

ra>K 



^ Po [^^""^ = i*, VA; = 1, . . . , m - X : D^^~^^ > l] P„[L» = 00] 



Applying the strong Markov property once more, this time to Tm-K, and using 
the i.i.d. structure of the environment, we get that the above is equal to 



m>K 



Pm-K 

^Po 
^Po 



r] Po JVA; = 1, . . . , m - /s: : D^^~^^ > 1 P„[P> = 00] 



D(^) = rl Po 



\Jk = l,...,m-K:D^;'-''^>l 



Pm-K[D = 00] 



rrOK 



D(^)=z" J] Po[ri = r^_x] = Po 



'm>K 



This proves (35). Now we need to show that 



(39) 



Po 



Po 
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The proof is essentially the same as that of Proposition 2.2 of [BS08a]. At first, no- 
tice that, given {d[^\ . . . , D^^^), the distribution of -D^+i depends only on -D^^^ 

Therefore, the process {D[^^)o<k<K is Markov, just as the process {Vk)o<k<K- Both 
processes get absorbed after the first return to 0. Then (39) will follow if we show 
that they have the same transition probabilities and that dI^"* has the same dis- 
tribution as Vi. Let m > 1 and l<k<K— loTm = k = 0. Notice that if 
the number -D^^'' of downcrossings of the edge {K — k, K — k — 1) prior to Tk 
is m then the number of up crossings of the same edge prior to Tk equals m -|- 1. 
Therefore, the number dI^\ of downcrossings of the edge (K — k — 1, K — k — 2) 
prior to Tk is equal to the number of failures in (^Z^"*^"^^) before the (m-l-l)-st 
success, which is F^^n+i''~^^ ■ On the other hand, if 14 = m then, by (32) and (33), 

Vfe+i = F^li- But for alH, J > random variables -F^+i and -F^li have the same 
distribution. □ 

7. Law of large numbers and ballisticity 

While (25) gives the law of large numbers in the transient case the renewal 
structure does not say anything about the recurrent case. The following general 
result covers both the transient and the recurrent case. 

Proposition 13. There is a deterministic v G [—1, 1] such that Po-a.s. X^/n — >• v 
for n oo. 

Proof. It can be shown exactly like in the proof of [Zer05, Theorem 13] that if 
sup„>o Xn — oo a.s. then 

X 1 

(40) limsup — - < — a.s., where 

u+ := ^ Po[Tj+i - Tj > j] e [1, oo], and 
X 1 

(41) liminf — - > — a.s. if m+ < oo 

n-»oo n 

sec the last line on p. 113 and the first line on p. 114 of [Zer05]. Similarly, by 
symmetry, if inf„>oX„ = — oo a.s. then 



(42) liminf — - > — a.s., where 

n^oo n M_ 

u- := 5Z Po[T_j_i - T_j > j] e [1, oo], and 



(43) limsup — - < — a.s. if w_ < oo. 



n— +0O 



n U- 
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Now due to Theorem 1 there are only three cases: Either the walk is transient 
to the right or it is transient to the left or it is recurrent. Consider the case of 
transience to the right. If < oo then lim„X„/n = follows directly from 

(40) and (41). If = oo then lim„X„/n = follows from (40) and inf„X„ > 
—oo. Transience to the left is treated analogously. In the case of recurrence we 
have a.s. both sup„ Xn — oo and inf„ Xn — — oo. Hence both u+ and U- are infinite 
due to (41) and (43), respectively. Therefore, by (40) and (42), hm„ Xn/n = 0. □ 

Lemma 14. Let {Zk)k>o be a {Geom.{l / 2), u) -branching process, where v is the 
distribution ofrjk '■— — M + 1, and recall definitions (8), (32) and (33). Then 

(44) Eq[V] < oo Eo[Z] < oo, where V :^^Vk and Z Zj,. 

k>0 k>0 

Proof. As an intermediate step we first consider the auxiliary Markov chain {Wk)k>o 
defined by 

(45) Wo-.^O, W^.+i F(5],+i)vM- 

This is a branching process with migration in the following sense: At each step, 
it exhibits two types of behavior: 1) if Wk > M — 1 then one particle immigrates 
and then all Wk + 1 particles reproduce; 2) if Wk < M — 1 then M — Wk particles 
immigrate and then all M particles reproduce. 
We shall first establish the equivalence 

(46) Eo[V] < oo ^ Eo[W] < oo. 
where, as usual, 

(47) AtW := inf{A; > 1 I lyfe = 0}, := iya{ifc<Ar(w)}, and W ■.^Y.Wk. 

k>0 

Comparing definitions (32) and (45) we see that Vk < Wk for all k, which yields 
the implication <^= in (46). For the reverse implication, assume that -Eo[^] is finite, 
omce iV(^) <V + 1 this imphes that (V^) k>o is positive recurrent. The following 
lemma, whose proof is postponed, will help us to compare {Vk)k>o and {Wk)k>o- 

Lemma 15. Let K he the transition matrix of a positive recurrent Markov chain 
with state space No and invariant distribution tt. Assume also that all entries of 
K are strictly positive. Fix a state j e No and a finite set J C No \ {j}. Modify a 
finite number of rows of K by setting 



K{i,-), ifi^J; 
K{j,-), ifieJ. 



Then a Markov chain with the transition matrix K is also positive recurrent and its 
unique invariant probability distribution W satisfies W{n) < CQ7r{n) for all n e Nq. 
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If we let K be the transition matrix of the Markov chain (Vfc)fc>o and set j — 
M — 1 and J — {0,1, . . . , M — 2} then K defined in Lemma 15 is the transition 
matrix of {Wk)k>o- Moreover, all entries of this K are strictly positive due to (2). 
Consequently, we may apply Lemma 15 and get that {Wk)k>o is positive recurrent 
and its invariant probability distribution W is bounded above by a multiple cqit of 
the invariant probability distribution tt of (Vfc)fc>o. By Theorem 5.4.3 of [Du05], 
TT and 7f can be represented as tt = p/Eo[N^^^] and n = p/Eo[N^^^], where for 
seNo, 



-N(^)-l 

p{s) := Eo J2 Mvk=s} 
Therefore, also p < cjp. However, 



and p{s) := Eq 



Ar(w)_ 

E 

k=0 



(48) 



Eo[W] = Eo 



jfc=0 s>0 



{Wk=s} 



E^^(*) 



s>0 



and, similarly, Eo[V] = J2s^P(^)- Consequently, -Bo[l^] < cyE'ofy]. This gives the 
implication =^ in (46). Next, we show that 

(49) Eo[W] < oo <^ Eo[Z] < oo. 

As in Lemma 6 we decompose the process {Wk)k>o into two components. 

Lemma 16. Fork>0 let Z'^ := Wk+i - F^^\ Then {Z'i^)k>o is a (Geom(l/2), v)- 
branching process, where v is the common distribution ofrjk '■= F^^^ — M + 1 under 
Pi. 

The proof of Lemma 16 is almost identical to the one of Lemma 6 and, thus, is 
omitted. _ _ _ 

Since F^^^ > 0, we immediately obtain < Wk+i, where Z'j^ is defined by 
replacing W in (47) by Z'. By Lemma 16, (2'^)^ and {Zl.)k have the same dis- 
tribution. Therefore Eq[Z] = Eq[Z'] < Eq[W], which yields the implication =^ in 
(49). For the opposite direction assume that Eo[Z] < oo. Then, as in the proof of 
(46), {Z'jjk^o is positive recurrent and, by the equivalent of (48), its invariant dis- 
tribution, say tt', has a finite mean. Since Zj^ and are independent, it follows 



from Lemma 16 that the convolution of tt' and the distribution of is invariant 



for {Wk)k>o- This convolution has a finite mean as well, which implies, as in (48), 

that -Eo[W^] is finite as well. This concludes the proof of (49). The statement of 
the lemma now follows from (46) and (49). □ 

Proof of Lemma 15. It suffices to consider the case in which J has only one el- 
ement, i.e. J = {i} for some i j. The full statement then follows by induc- 
tion, changing one row at a time. Let (Cfe)fe>o and (Cfe)fe>o be Markov chains 
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with transition matrices K and K, respectively. Their initial point will be de- 
noted by a subscript of P and E. Since all the entries of K are strictly pos- 
itive. K is irreducible. It is recurrent, since its state i is recurrent. Indeed, 
P,[^k > 1 : = ^] = P;[3A; ^ 1 : Cfe = i] because of K{i, ■) = K{j, ■) = K{j, ■). 
Moreover, since (CA;)fe>o and (Ca;)a:>o ai'e indistinguishable as long as they do not 
touch i, i.e. since K(s, •) = K{s, •) for all s ^ i, we can switch from the process 
(CA;)fc>o to (Cfe)fe>o and obtain that Pi[3k > 1 : Cfe = ^] = -fjP^ > ^ '■ Ck — i]: which 
is equal to 1 because (Cfe)jk>o is recurrent. 

Similarly, one can show that (Cfc)A:>o is also positive recurrent. Define the hitting 
time a := mf{k > 1 | Cfc = (Cfc)fc>o and analogously a for (Cjt)ik>o- Then, 
again by [Du05, Theorem 5.4.3], p and p, defined by 



p{s) := 



V-l 

El 

.fe=0 



and p{s) :— E^ 



a-l 

El 

.k=0 



seNo, 



are invariant measures for K and K, respectively. Using the relations between K 
and K as above, we have for all s G No, 



(50) 



Pis) 



.k=0 



-1 



El 

.fe=0 



On the other hand, for all s e No, 



p{s) > Ei 



cr-1 



E lie. 



--3, Cfc=s} 



,fc=l 



K{t,j) E, 



cr-1 

El 

.fc=0 



{Ck=s} 



(50) 



K{i,j)p{s). 



Since (Cfc)fc>o is positive recurrent, p's total mass, £^i[cr], is finite. Consequently, by 
the above and since K{i,j) > 0, p's total mass, Ei[a], is finite as well. Therefore, 
(Cfe)fc>o is positive recurrent and its invariant measure 7f satisfies W < cqt: with 
c^:^E,[a]/{Ei[a]K{i,j)). □ 

The following lemma is the counterpart of Lemma 10. 

Lemma 17. Let v he the distribution of F^^ — M + 1 under Pq. Then 9 defined 
in (7) for the (Geom(l/2), v)-hranching process is equal to 1 — 5. 

Proof As in the proof of Lemma 10, 9 = Eq[F^^^] - M + 1 since h — 1. Switching 
failures and successes in (23) and replacing u{x,i) by 1 — a;(x, i) yields Eq[F^] — 
M ^-5. □ 

Proof of Theorem 2. The first statement of the theorem, the existence of the ve- 
locity is just Proposition 13, or (25) in the transient case. If (5 £ [—1, 1] then 
the walk is recurrent by Theorem 1 and therefore w = 0. 

Now let \5\ > 1. Without loss of generality we may assume S > 1. Then the 
walk is transient to the right by Theorem 1. By (26), v > iff Eq[t2 — Ti] < oo. 
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By Lemma 11 with p = 1 this is the case iff EQ^Ylk>o^k\ < oo- By Lemma 12 

this holds iff Eq [ J2k>o < oo. Due to Lemma 14 this is true iff Eq [ ^;j>o ^f^] 
is finite. By the second statement in Corollary 4 this holds iff ^ < —1. Thus, by 
Lemma 17, i; > iff (5 > 2. □ 

8. Central limit theorem 

Lemma 18. Let (Vfc)fc>o be defined by (33). Then 5 > 4 implies that the random 
variable V := ^j^.>o Vk ho^s a finite second moment. 

Proof. Let {Wk)k>G and W be defined by (45) and (47), respectively, using the 
same sequences {F^^'^)i>Q, k G No, as for the process {Vk)k>o- Since Vk < Wk, we 
have iV(^) < iV(^) and Eo[V^] < Eo[W^]. We shall prove that the latter is finite. 
By Minkowski's inequality we have 

2-t \ 1/2 



1/2 [ ~ f \ \ 

Prom Lemma 16 we see that Zk :— Wk-^\ — F^ defines a (Geom(l/2), i/)-branching 

process, where v is the distribution of F^^ - M ^ 1. Therefore, Wl < 2{Zl_^ + 

{Fm'^^Y)- Combining this with the fact that {a+hf^ < a^Hfe^/^ for all a,b>0, 
we get 

k=l 
k=l L 

Applying Holder's inequality with 1/q; + 1/q;' = 1, q;> 1, we obtain 



1/2 

(51) (£;oM) < v^E (^0 [^fc'-i])'^^'"^ (^o[A^^^) > k]y 

oo 



fe=l 

,(0)^^2a^l/{2a) ^ ^ i,n l/(2a') 

fe=l 

We are going to show that 

(i) for every £ e (0, 5 — 4) there is a constant Cs{e, 6) such that 

Po[M^^ >k]< csk-^^' for all k e N; 

(n) for each £ e N there is a constant cg{£) such that Eq [Zl] < cg{£)k^ for all 
k e No. 
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Let us assume (i) and (ii) for the moment and see that both series in the right 
hand side of (51) are finite. Choose a' e (1,5/4) so that a — a' /{a' — 1) is an 
integer and let e — {5 — 4q;')/2. Then by (i) and (ii) for all A; > 1, 

(Eo [Zl%]Y'^^''^ (Po[iV(^) > k]f'^^'''^ < cio(a',5)fc^-('-^)/('"') = cio)t-'/('"'). 

Since 5/(40;') > 1, the first series in the right hand side of (51) converges. It is 
obvious now that for the same choice of a' and e the second series in the right 
hand side of (51) also converges. Therefore we only need to prove (i) and (ii). 

Proof of (i). Observe that Wk is zero if and only if both Z^-i and F^~^^ are 
equal to zero. Set Nq := and consider the times Ni := inf{A; > A^j_i \ = 0}, 
i e N, when the process {Zk)k>i dies out. Due to Lemma 17 and 5 > 4 the 
parameter 9 for the process (^jk)jk>o satisfies 

(52) 6 = 1-5 < -3. 

In particular, Corollary 4 implies that the process {Zk)k>o is positive recurrent. 
Therefore, all N^, i e N, are a.s. finite and (N^ — Ni-i)i^fq is i.i.d.. We are 
interested in the sequence (F^'^)^^^. Observe that (-^m^)„>o is i.i.d. and, by con- 
struction, F^^ is independent from = a{{Zk,k < < n}). It is 
then straightforward to check that each F^'^ is independent from J^jsf., i E N, 
and is i.i.d.. Let x := inf {i > 1 1 F^f'^ = O}. Then x has the geo- 
metric distribution on N with parameter p := P[F^^ = 0] e (0,1). Therefore, 
7V(w^) = TV^ = Er=i(^« - ^^-i) and 

Po[A^(^) >k] = Po [Ni-^ > k'-^] < E ^0 [Nt'M.=^}] 

m>l 

m>l 

where P e (1, - P' = P/iP - !)■ Denote {S - e)(5 by 7. Writing 
Nm as Y^^=i{^i ~ ^i-i) and using Minkowski's inequality we get {Eq[N'^Y/'^ < 
m{EQ[N2\Y^'^ ■ Substituting this into (53) we obtain 

m=l 

Prom part (iv) of Theorem A and (52) we know that Po[-^i > A;] ~ c^k~^ . There- 
fore, and since 7 < 5 by assumption, Po[Nl > k] is summable in k. Consequently, 
Eo [iV7] = ci2{e,6) < 00. This implies (i). 

Proof of (ii). The proof can be easily done by induction in £. The statement 
is trivial for i = 0. (Here 0° = 1.) Assume now £ > 1 and that for each j e 
{0, 1, 2, . . . — 1} there is a constant C9(j) such that Eq [Zl\ < cg{j)k^ for all 



26 



ELENA KOSYGINA AND MARTIN P.W. ZERNER 



k e No- Using that {Zk)k is a (Geom(l/2), i/)-branching process we have for all 
k eNo and n eN, 



— En 



^(fc+i) I 1 

4i + ^{Zu+nu<i} 



(54) 



(55) 



< Eo 



(0) 



•+fr)' 



Observe that the expectation in (54) is bounded by a constant ciz{t). To control 
the series in (55) we use the following lemma, whose proof is postponed until after 
the end of the present proof. 

Lemma 19. Let (^t)ieN be non-negative i.i.d. random variables such that -Ef^i] = 1 
and E [{j^j < oo for some positive integer £. Then there is a constant C14 such that 
for all n > i, 

e-i 

E [{^1 + ^2 + ■ ■ ■ + iuY] <n' + c^,Y,n^. 

m=l 

Applying this lemma to the series in (55) we obtain 

e-i 



Eo [Zl^i ] < ci3 + J] + ci4 n"* Po [Zk + Vk^n] 

n>e \ m=l / 

e-1 

< ci3 + Eo [{Zk + VkY] + ci4 Yl ^0 [(^^ + "^f^r 



m=l 



e-1 



< Eo[Zi]+J2ci5{mJ)Eo[Z^]. 



m=0 



By the induction hypothesis we conclude that Eq [Z^j^^ — Z[\ < ci^k^ ^ Summa- 
tion over k implies (ii) and finishes the proof of Lemma 18. □ 

Proof of Lemma 19. By expanding and using independence, 



I 



m 
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Since E[^i] = 1 the summand for m = £ is equal to n\/{n — £)\ < n^. For the other 
terms we estimate the factor (^) from above by n"* and define the constant 



cu '■— max 

i<m<e ^ „, , „, , 

i<^i,...A 



□ 



Proof of Theorem 3. Let > 4. By symmetry we may assume without loss of 
generality that 6 > A. Then, by Lemma 18, -E'o[(^^>^ Vfe)^] < oo- By Lemma 12 
this implies E^KJ^k ^^T] < Lemma 11 for p = 2 gives Eo[{t2 — ti)^] < oo. 
This implies the claim, as indicated in (27) and (28). □ 

9. Further remarks, a multi-dimensional example, and open 

questions 

Remark 3 (Permuting cookies). Note that permuting cookies within the cookie 
piles, i.e. replacing (a;(-,i))j>i by a;(-, 7r(z))j>i, where tt : N — > N is a permutation, 

does not change S, defined in (3). Therefore, permuting cookies does not change 
the classification of the walk as described in Theorems 1 and 2. This fact can also 
be seen as follows without using the results in Theorem A from the literature. 

At first, observe that we may assume without loss of generality that tt is a 
finite permutation, since all cookies in a cookie pile except for a finite number 
are placebo cookies. We may even assume that alH > M are fixed points for tt. 
Indeed, otherwise just replace the original M with max{7r(i) | i < M}. To argue, 
for example, that permuting cookies does not turn a walk which is recurrent from 
the right into one which is not recurrent from the right or vice versa, recall the 
definition of S^^^ in (12) and of rjk in Lemma 7 and denote by > M the index 
of the M-th failure in the sequence (y/*^^)j>i. Then rjk can be written as 

(k) (k) (k) 



(56) = y <" = j: Yr> + e y."" = e n's + e y. 



7r(i)' 

M+1 i=l i=M+l 



where we used in the last step for the first sum that tt maps {1, . . . , M} onto 
itself and for the second sum that all i > M are fixed points for tt. For the 

(k) 

same reason, a}^' > M is also the index of the M-th failure in the permuted 
sequence Y^^^y This shows that applying tt does not change the distribution u of 
r]k. Therefore, recurrence to the right, as characterized in Lemma 7, is invariant 
under permutations. Since the proof of Lemma 7 did not use any results from 
Section 2, this proof is self-contained. 

Similarly, one can show that the positivity of speed is invariant under per- 
mutations. Indeed, in the proof of Theorem 2 we have shown that > iff 
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^o[^k>o ^k] < oo. By the above argument, the distribution of {Zk)k>o remains 
unchanged under permutations. 

Remark 4 (Higher dimensions). Multi-dimensional ERW with cookies that in- 
duce a bias with a non- negative projection in some fixed direction were considered 
in [BW03], [Ko03], [Ko05], [Zer06], [HH06] and [BR07]. A special non-stationary 
cookie environment with two types of cookies pointing into opposite directions 
was studied in [ABK08]. However, to the best of our knowledge so far there are 
no criteria for recurrence, transience or ballistic behavior of ERWs in i.i.d. envi- 
ronments of "positive" and "negative" cookies in higher dimensions. To us, it is 
not even clear how such criteria could look like. In the following example we shall 
indicate that the situation cannot be as simple as in one dimension. We shall show 
that, unlike for d = 1 (see Remark 3), permuting cookies in higher dimensions may 
change the sign of the velocity. 

Example. Let d > 4. Denote by uj{x,e,i) the probability for the ERW to jump 
from X e Z*^ to the nearest neighbor x + e upon the i-th visit of x. Fix < 
e < l/(2(i) and consider the two deterministic cookie environments cuk, k — 1,2, 
defined by 

Uk{x,±ej,i) := ^ ±e(-l)'+'=l{,=i.i6{i,2}}, xeZ'^, 1 < j < d, i>l, 

where {ei, . . . , e^} is the canonical basis of Z'^. In both environments, Ui and uj2, 
there are M = 2 cookies per site. In the environment uoi the walk experiences 
a drift into direction ei upon the first visit to a site and an equal drift into the 
opposite direction — ei upon the second visit. Otherwise, it behaves just like a 
simple symmetric random walk. We shall show: 

(57) There is some v > such that hm — - = vei Po,a;ra-S.. 

n— »oo 77, ' 

The environment UJ2 is obtained from uoi by permuting the two cookies at each 
site. By symmetry, we obtain from (57) that for the same v > 0, we have Po,a)2" 
a.s. MvcLnXn/n — —vei. Thus, in this example, permuting two cookies reverses the 
direction of the speed. 

For the proof of (57) denote by Rn.i := {Xm \ m < n} the range of the walk 
before time n e N and by i?„^2 {x & H'' \ 3k < m < n Xk = x = Xj^} the set of 
vertices which have been visited at least twice before time n. It is easy to see that 
both ^Rn,i and ^Rn,2 tend to oo as n — > oo. Coupling {Xn)n>o in the natural 
way to a simple symmetric random walk (5'„)„>o on Z*^ yields that {Xn)n>o can 
be represented as 

#Rn,l #Rn,2 

Xn^ Sn + 2eian - 2eibn, where On = ^ Yi^i and &n = ^ ^i,2 

i=l i=l 
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and Yij {i > 1, j = 1, 2) are independent and Bernoulli distributed with parameter 
e. Consequently, 

n n #-Rn,i n #-Rn,2 n 



The first term on the right hand side of (58) tends to zero Po^^^J^-a,.s.. The same 
holds for the last term in (58) since by the strong law of large numbers both 
an/i^Rn^i and 6n/#-Rn,2 tend to e as n — >• oo and ij^Rn,2/n is bounded. Therefore, 

(59) lim inf > 2e lim inf ^^^'^ ~ ^^"'^ 

To bound the right hand side of (59) from below we introduce the projection 
TT : Z*^ — > Z*^"-^ defined by n{xi,X2, ■ ■ ■ ,Xd) '■= {x2, ■ ■ ■ ,Xd) onto the subspace 
spanned by 62, ... , and consider the process (X^)„>o defined by X'^ := 7r(X„). 
Under Po.wi, {^'n)n>Q is a simple symmetric random walk on Z*^"^ with holding 
times which are i.i.d. and geometrically distributed with parameter 1 — 1/d. As 
above, denote by R'^ i :— {X'^ \ m < n} the range of this walk before time n e N 
and by i?^ 2 •= {'^ ^ ^'^^ I < m < n X^. = x = X^J the set of vertices which 
have been visited at least twice before time n by (X^)„. 

Returning to the right hand side of (59) we first note that #i?n,i — #-Rn,2 = 
#(-Rn,i\-Rn,2) is the number of vertices which have been visited exactly once 
by {Xn)n before time n. This number is greater than or equal to the number 
i^{I^ni\R'n2) '^^ vertices which have been visited exactly once by the projected 
walk {X'^)n before time n. According to [Pi74] this last number satisfies a strong 
law of large numbers and grows like p^n, where p is the probability that (X^)n 
never returns to its starting point. Since d > 4 and simple symmetric random 
walk in three or more dimensions is transient, we have p > 0. Therefore, by (59), 

(60) lim inf " > 2ep^ > 0. 

In particular, (X„ ■ ei)„ is transient to the right. Using a renewal structure like 
in [SZ99] for RWRE and in [BR07] for once-ERW and as outlined in Section 6 
this implies that (A„ • ei)„ satisfies a strong law of large numbers under Po,tJi) i-e. 
Po,a;i-a.s., {Xji • ei)/n — > v for some v > 0. Due to (60) we even have v > 0. Since 
obviously Po,a;i-a.s. X'^/n — > , this yields the statement (57). 

Open questions. We have already mentioned that not much is known about 
positively and negatively ERW in > 2. Below we shall discuss d = 1. It might 
be also interesting to consider ERW on strips Z x {0, 1, . . . , L}, L > 1. 

(a) Recurrent regime. For the case of non- negative cookies and S < 1, D. Dol- 
gopyat has shown, [D0O8], (the case of strips was also considered) that, under 
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some assumptions, converges in law to the unique pathwise solution W{t) 

(see [CD99]) of the equation 



where B{t) is the Brownian motion with variance t. Can this result be extended 
to positively and negatively excited random walks? What happens in the case 



(b) Transient regime with zero linear speed. A.-L. Basdevant and A. Singh 
obtained in [BS08b] for non-negative (deterministic) cookie environments and 1 < 
5 <2 the following results. 

1. 11 5 G (1, 2) then converges in law to a random variable S~^^'^, where 
S is a positive strictly stable random variable with index S/2, i.e. with 
Laplace transform Ele'^^] — e~^^^^^ for some c > 0. 

2. li 5 — 2 then converges in probability to a positive constant. 

Their proof is based on the study of branching processes with migration but uses 
the assumption that all cookies are non-negative. The same result with essentially 
the same proof might hold in the more general setting studied in the current paper. 
Is there a result for 5 = 2 similar to (ii) of [KKS75]? 

(c) Transient regime with positive linear speed. We do not know whether our 
condition S > 4 for the validity of the central limit theorem is optimal. How does 
the process scale for 6 e (2, 4]? Is the behavior similar to (iii) and (iv) of [KKS75]? 
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